Biased Cosmology: Pivots, Parameters, and Figures of Merit 
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In the quest for precision cosmology, one must ensure that the cosmology is accurate as well. 
We discuss figures of merit for determining from observations whether the dark energy is a cos- 
mological constant or dynamical, with special attention to the best determined equation of state 
value, at the "pivot" or decorrelation redshift. We show this is not necessarily the best lever on 
testing consistency with the cosmological constant, and moreover is subject to bias. The standard 
parametrization of w{a) = wo + uia(l — a) by contrast is quite robust, as tested by extensions to 
higher order parametrizations and modified gravity. Combination of complementary probes gives 
strong immunization against inaccurate, but precise, cosmology. 



I. INTRODUCTION 

Discovery of the acceleration of the cosmic expansion 
has precipitated widespread activity and plans to un- 
cover its nature. A significant first question to answer 
is whether the responsible physics is consistent with a 
cosmological constant in Einstein's field equations. Be- 
yond this, we seek to know the dynamics of the dark 
energy, for example through the value and variation of 
the equation of state, or pressure to energy density ratio. 

In evaluating the leverage of experiments one needs to 
put forth either a set of benchmark models to distinguish 
or a model independent parametrization that places a 
measure or distance in model space. Given the lack of 
well motivated benchmarks other than the cosmological 
constant, the second approach is favored in the literature. 
The ability of an experiment can then be quantified by a 
figure of merit, ideally rooted in distinctions in the fun- 
damental physics. Recently, the DOE-NASA-NSF Dark 
Energy Task Force (DETF: IJ) proposed one possible fig- 
ure of merit, involving the area of the equation of state 
uncertainty contour. 

We examine to what extent this suggestion gets to the 
heart of the physics, in i|n] Moreover, apart from the 
theoretical precision of a parameter constraint, we must 
be concerned with the accuracy of the parametrization - 
the possibility of observational and interpretational bias 
of the parameters and the cosmology. We consider this 
from several angles in illlll treating issues of decorrelated 
parameters, astrophysical evolution and dark energy time 
variation, and beyond Einstein gravity. In ill VI we return 
to the question of figure of merit and discuss the role of 
joint confidence contours. 



II. FIGURE OF MERIT 

How to robustly quantify knowledge of the nature of 
dark energy is not clear in general. For example, a cosmo- 
logical constant has a particular value of the equation of 
state w = —1 and lacks any variation, w' = dw/dlna = 
0. But in the phase plane w'-w is the optimum measure 
the area of a likelihood confidence level contour, the vol- 



ume of the overall N-dimensional (equation of state plus 
matter density etc. parameters) confidence surface, the 
largest eigenvalue (shortest dimension of the ellipse de- 
fined near the likelihood maximum), etc. (see Q for an 
early discussion of some of these)? 

This difficulty persists even if wc restrict to the narrow 
question of whether the dark energy is a cosmological 
constant A or not. If we strive to optimize the deter- 
mination of the value w at some redshift, obtaining a 
so-called sweet spot or pivot value Wp, we can be misled. 
Even if we determine the value Wp is -1 the variation w' is 
still important since models distinct from A exist where 
Wp — —1, w' ^ 0. Indeed in ijlll El we will show that bi- 
ased parametrization can lead to exactly this situation. 

In a completely blank phase space, minimizing the 
area of the equation of state contour, as proposed by 
the DETF in the gaussian approximation, is a good 
strategy. However, we are not completely blind to the 
structure of the physics; Fig. ^ shows distinct, phys- 
ically motivated regions identified by Q due to the 
overall dynamics of scalar fields and further generaliza- 
tions including modified gravity |J]. Thawing models 
evolve away from the cosmological constant state and 
possess 1 + w < w' < 3(1-1- w), while freezing models 
move toward the cosmological constant and today lie in 
0.5w{l + w) > w' > 3w{l+w). (In the figure we translate 
to Wa = —2w'\z=i to fit the standard parametrization 
used in the rest of the paper.) This physical structure 
suggests specific strategies for optimizing our knowledge 
of dark energy. 

While there are benefits to uniform shrinking of error 
contours (which translates to minimizing cjiwp) x cr(wa) 
in the gaussian approximation), the phase space struc- 
ture shows other approaches can be more valuable. For 
a model in the freezing region, we see that more tightly 
constraining the narrow dimension of the contour, cor- 
responding to the largest eigenvalue, is near optimal to 
distinguish the data from the cosmological constant - and 
to separate it from the other physical class of the thawing 
behavior. 

However, for a model in the thawing region, limiting 
the long dimension of the contour (the smallest eigen- 
value), is the key discriminant from A. Indeed, experi- 
ments that are only sensitive to an averaged equation of 
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FIG. 1: By using the physical structure of the dark energy 
phase plane, we find optimal quantities for figures of merit 
for different regions. The shaded areas show the freezing and 
thawing classes Q; they intersect at the cosmological constant 
A. Confidence contours from next generation cosmological 
observations are shown for two dark energy models, one in 
each class, pointing up very different criteria for distinguishing 
them from A (dark, blue arrows) or from the other class (light, 
red arrows). 



state (such as most planned ground based experiments, 
due to limited redshift baseline) have a degeneracy di- 
rection squarely through the thawing region, making it 
virtually impossible for these to distinguish that half of 
physics classes from the cosmological constant. Beyond 
A, to maximally separate data pointing to the thawing 
region from freezing models one would seek to constrain 
the contour along nearly the vertical direction. 



TABLE L Figures of merit vary for different circumstances. 
Case denotes the region where the true universe lies (blank 
meaning all points in phase space are equivalent). Goal de- 
notes the science objective, e.g. distinction from A or between 
thawing and freezing classes. 



Case 


Goal 


Figure of Merit 


Blank 


Anything 


Area 


Thawing 


A 


Long axis 


Thawing 


vs. Freezing 


~ Wa 


Freezing 


A 


Short axis 


Freezing 


vs. Thawing 


~ Short axis 


Defect 


A 


Wp 



SO to give a constant value w.^ Furthermore, horizontal 
squeezing of the confidence contour is never optimal for 
distinguishing the freezing and thawing classes. 

Tabled summarizes the optimal characteristics to con- 
strain - "figures of merit" - for greatest science return 
on the dark energy equation of state. Clearly no one fig- 
ure of merit is optimal in all circumstances. However, we 
do not know how to weight the likelihood that the true 
model will lie in a particular region of phase space, so it is 
difficult to look for even a "best average" figure of merit, 
that gives the greatest good for the greatest numbers, or 
greatest insight for the greatest likelihood of cases. We 
discuss this further in ^W\ 

What would be beneficial is the power to significantly 
alter the orientation of the contours at a given fiducial 
point in the phase space. If we could rotate the contour 
around a thawing model 90 degrees then these would 
be more easily distinguishable from a cosmological con- 
stant (whereas freezing models would be less so) . This is 
completely different from constraining Wp, i.e. minimiz- 
ing a{wp), however. The orientation, or main degeneracy 
direction, is related to the pivot redshift Zp itself, and is 
a property of the cosmological probe, or combination of 
probes, used. Our desired 90 degree rotation corresponds 
to a negative Zp. Practical probes all tend to have nearly 
the same degeneracy direction (see, e.g., 6]) and com- 
bining probes averages the direction, so it is very diffi- 
cult to rotate the contours even tens of degrees. (Note 



The uncertainty C7{wp) in the pivot value Wp (see the g^t strong lensing does provide a way to obtain Zp < 



next section for exactly what is a pivot) corresponds not 
to the short dimension of the contour, but the width of 
the contour at fixed w' (or Wa), i.e. w' held to its fiducial 
value and not treated as a free parameter. This gives 
a horizontal cut slanting across the contour, not along 
the short axis (unless the equation of state variables are 
uncorrelated; see iJIVI for illustration of this and further 
discussion) . Minimizing the horizontal width of the con- 
tour only gives the optimal science in the special case 
when the data lie horizontally offset from the cosmologi- 
cal constant - i.e. in the "no model's land" between the 
freezing and thawing regions, where the scalar field po- 
tential is fine tuned to balance the kinetic energy just 



T|, but systematics distort the contour so as to prevent 
significantly useful rotation.) 

To understand the heart of dark energy physics we 
need high precision to constrain the dynamics w'-w; we 
have seen that a figure of merit for that precision is non- 
trivial. But we also must make sure that the cosmology 



^ This region can be attained by a frustrated network of topological 
defects, giving the constant value w = —N/3 for N the value of 
the defect dimension. For a cosmic string dominated universe, 
w = —1/3, and for domain walls w = —2/3, both of which are 
strongly disfavored by current data |3|. 



fitting and its interpretation are accurate, that there is 
neghgible bias. From Fig.nwe see that a shift in the best 
fit parameters could easily move a thawing model, say, 
to a result appearing as the cosmological constant or a 
freezing model. Moreover, we must test the parametriza- 
tion of the phase plane itself, to ensure that with a few 
parameters we robustly capture the key physics. The 
next section studies these two issues, of bias in the ob- 
servations and in the interpretation. 



III. BIAS 

For model independent treatment of the equa- 
tion of state (EOS) phase space w'-w, the standard 
parametrization contains two parameters, describing the 
value and variation of the EOS: 



dO/dp. Put more simply, when the covariance matrix is 
diagonal. 



Sp^ = {F.-olhT.^^^^O,, 



(4) 



and Ok is the fcth observable (e.g. supernova magni- 
tude at some redshift bin), AOk is the observational 
quantity offset (due to either theory error or systematic 
measurement error), and i^tot is the Fisher matrix from 
all observables. We consider the cosmological probe of 
the distance-redshift relation for z = — 1.7, as from 
a future survey of Type la supernovae by the Super- 
nova/Acceleration Probe (SNAP 13] , which of course in- 
cludes systematics) , together with future measurement of 
the distance to the cosmic microwave b ackg round (CMB) 
last scattering surface, as from Planck 



ickgr 



w{a) = Wo + Wa{l — a). 



(1) 



This is well known to be accurate in describing a wide 
variety of physical models ^ ^] . Moreover, (2|] demon- 
strated that even next generation observations would be 
generically capable of tightly constraining only two pa- 
rameters. However, they pointed out that extended or 
higher order parametrizations could be useful in assuring 
the resistance to bias of the fitted cosmological parame- 
ters. 

Another possibility for dark energy parametrization is 
the closely related form employing decorrelated variables. 



w{a) 



Wa{ap -a). 



(2) 



Here the pivot redshift [Tfl llil [ill Zp = a" ^ — 1 is 
chosen such that Wp = 'w{zp) and Wa are uncorrelated. 
Known drawbacks of this parametrization include the de- 
pendence of Zp and hence Wp on the method of probing 
the cosmology, the specific experiment design, the fidu- 
cial model, and the priors employed. This dependence 
causes a lack of independent physical meaning of Wp, i.e. 
Wp from one specific experiment for learning about the 
universe cannot be directly and generally compared to 
the Wp value from another. The plus side is that Wp can 
be more precisely determined than wq, and indeed is the 
most precisely determined single value of w(z). 

The question we take up here is whether the Wp-Wa 
parametrization is also more accurately determined than 
WQ-Wa- We examine their robustness against theoretical 
and observational biases that lead to a shift in the fitted 
parameters. 

Parameter biases 5pi induced from offsets AO^ in the 
observable quantities are calculated using the Fisher for- 
malism, where maximizing the likelihood leads to 

5p = AAO = {u'^C-^uy^U^C-^£i.O, (3) 

where O is the vector of expected observations, C is 
the covariance matrix of observational errors, and U — 



A. Extended time variation 

Disallowing any time variation in the dark energy EOS, 
i.e. holding the value w constant for all redshifts or fit- 
ting only an averaged value, not only obscures the physics 
but even biases the constant or averaged value (e.g. jlS]). 
The Wa parametrization removes that difficulty by allow- 
ing for variation, Wa — —dw/da. We should ensure, how- 
ever, that there is not a continued hierarchy of bias, i.e. 
that neglecting a second derivative term does not bias 
the measured variation Wa ■ 

To some extent, this robustness is already taken care 
of by the physical foundation of the Wa parametrization - 
that it was designed specifically to model accurately the 
exact effect of a range of dark energy models (unlike the 
vast majority of alternate parametrizations). Neverthe- 
less, it is worth explicitly demonstrating the robustness. 

To do this, we adopt a parametrization with an explicit 
second derivative d^w/da^ ^ 0. We choose Model 3.1 
from [3, 



w{a) = wq +Wa{l - a''), 



(5) 



again because of its physical foundation as discussed in 
Q. Now d^w/da'^ — -b{b - l)waa''^^. The phase space 
behavior is given by w' = b{w — Woo), where Woo is the 
high redshift value of w. By considering cases corre- 
sponding to both freezing and thawing models (evolution 
toward and away from cosmological constant behavior, 
respectively), we can investigate the stability of the first 
derivative only (wa) parametrization. 

First, consider a freezing model with wq — —0.9, 
Wa = 0.2. As we change b from its canonical value of 
unity, but attempt to fit the cosmology within the stan- 
dard parametrization, we will unavoidably bias the val- 
ues of the cosmological parameters. Figure |21 shows the 
fractional bias Sp/a^p), i.e. how many standard devia- 
tions the parameter p is offset, for joint estimation of 
{flm,u)o,Wa} or alternately {flmjWp^Wa} (plus any nui- 
sance parameters). That is, we compare the robustness 



of parametrization |5J vs. Q. While wq is essentially un- 
biased, Wp can suffer bias at a significant fraction of the 
la statistical uncertainty (wa and flm are negligibly af- 
fected). Note that the dark energy model considered here 
lies within the freezing region w{l + w) ^ w' > 3w(H-w) 
for b = 0.45-1.35. 
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FIG. 2: Dark energy with more complex time variation than 
the standard two parameter model, but interpreted in terms 
of Wo, Wa, will bias the parameter estimation. Here we con- 
sider observational constraints from next generation super- 
nova and CMB measurements on a three parameter model in 
the freezing class. The wo and Wa parameters are quite ro- 
bust, nearly unbiased, but the sweet spot, or pivot, value w^ 
can be appreciably misestimated. 
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FIG. 3: As Fig. 121 but for a model evolving away from a high 
redshift cosmological constant like state, i.e. thawing. 



So the wo-Wa parametrization is an excellent, fair de- 
scription of the cosmological model even when the dark 
energy has extended time variation, in both the freezing 
and thawing classes of physics. These classes describe 
many standard, physically motivated scenarios (see |3ilj| 
for a wide variety of both scalar field and modified grav- 
ity models). However one can certainly postulate other 
behaviors with more extreme time variation. We test the 
standard parametrization to the breaking point in the 
next section. 



Next we consider the thawing class of models. As men- 
tioned in 9||, when the high redshift value of the EOS 
Woo = — 1, i-e. starting from a frozen, cosmological con- 
stant like state, then the parametrization (O describes a 
line of slope 6 in the phase plane: w' = 6(1 + w), an ex- 
cellent approximation to a wide variety of physics models 
such as power law potentials and pseudo-Nambu Gold- 
stone boson models. The thawing region 1 4- w < w' < 
3(1 -I- w) is obtained for b = 1-3. 

FigureOillustrates that again the fractional bias is well 
under control for the WQ-Wa parametrization, but that Wp 
is subject to large biases. At the upper end of the thaw- 
ing region, where b — 3, Wp can be shifted by 1.7ct, an 
unacceptable bias to the cosmology. This opens up the 
prospect of both false positives and false negatives, where 
we either mistakenly think we have confirmed the cos- 
mological constant to high precision or incorrectly claim 
evidence for deviation from the cosmological constant de- 
spite A being true. In contrast, wq is misestimated by less 
than 0.3(7 (and Wa and flm are also cleanly recovered). 



B. Rapid transition 

Rapid transitions in dark energy behavior cannot be 
well fit by the simple two parameter model. In this case, 
one might require four parameters - asymptotic past and 
future values, time of transition, and rapidity of transi- 
tion - as discussed in Q. That article put forward a 
solution in Model 4.0, the e-fold model, 



w{a) = Wf + 



Aw 



1 + {a/aty/- 



(6) 



where Wf (woo) is the asymptotic future (past) value. 
Aw = Woo — Wf, at the transition scale factor, and r 
the rapidity (note that in Q , t was the reciprocal of the 
rapidity) . 

As the transition becomes more rapid, we expect the 
two parameter model to have greater difficulty fitting this 
behavior, and hence greater bias in the parameter esti- 
mation. Within the e-fold parametrization, r gives the 



characteristic e-folding scale of the transition, with t — 1 
corresponding to a Hubble time at the transition redshift. 
This provides a natural scale, and one might expect that 
inertia in the field evolution could lengthen the transition 
to T > f . 

Figure 0] shows the bias effects of a cosmology with an 
e-fold paranietrization behavior but interpreted in terms 
of WQ-Wa or Wp-Wa- As expcctcd, the two parameter 
models are good fits for slow transitions, but not for rapid 
transitions. The parameter behavior also depends on the 
magnitude of the transition Aw; here we fix Wf = — 1 
and use Woo ~ Aw — 1 as the independent variable, also 
taking wq — —0.9 as fiducial. Parametrizing in terms of 



begins to be appreciably biased for t ;$ 2, while 



Wo 



stays a fair estimator to r ^ 0.5. The bias in Wa tends to 
be greater than that in wq (and is slightly greater than 
in flm), but is still acceptable for r > 0.7. 
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FIG. 4: As Fig. 13 but for the e-fold model, as a function of 
Woo = w{z S> 1), with Wo = —0.9. When the equation of state 
evolution is rapid (small r), then estimates of the equation of 
state from the observations are increasingly biased. The pivot 
value Wp (light, red curves) is most distorted, while Wa (dark, 
black curves) is fairly robust (and wq, not shown, is more so), 
except for very sharp transitions. 



As the limit of an extreme transition we can consider 
a step function in the EOS at some redshift z^. Even 
for small steps this can produce a large bias in Wp, and 
again the fractional bias in wq is less. Note that [ly| 
found that for an increasing EOS one could in fact ob- 
tain a bias giving a counterintuitive negative Wa- While 
such eigenmode decomposition of the EOS is an elegant 
approach, the Fisher bias formalism equivalently gives 
the weight or "redshift sensitivity" functions for param- 
eter fitting (and can handle more general situations, as 



seen in following sections). The seemingly paradoxical 
bias result is explained by the degeneracies among the 
parameter set: while Wa may be biased down, wq or Q^ 
would be biased up to compensate. 

The possibility of individual parameters flopping 
around through degeneracies, even to the opposite sign, 
cautions against interpretation relying on a single pa- 
rameter (as was done with constant w in the early days). 
Analogously, it is important not to rely on a single probe. 
For the exact case considered by [la| , the opposite direc- 
tion paradox goes away if one considers both supernovae 
and CMB distance measurements, as the degeneracy is 
then restricted. 



C. Evolving observable 

While we have so far considered the bias due to theory, 
in terms of parametrization, we can apply the same for- 
malism to systematic offsets in the measurements. For 
supernovae, treatments include the possibility of evolv- 
ing luminosity (e. g. Llfln ,12 i .il7ij) and gravitational lensing 
amplification bias jl3| . Effects due to heterogeneous data 
sets were discussed in Il9| and systematics in dust extinc- 
tion properties in J20j. The propagation of systematic 
errors through to cosmological parameter biases is unfor- 
tunately less common for other cosmological probes (but 
see |21j for a nice treatment within weak gravitational 
lensing, and J22l | for one instance for cluster masses). 

Here we combine the two issues by examining how 
a measurement systematic interacts with the theory 
parametrization. We take a hypothetical offset in su- 
pernova luminosity in terms of the absolute magnitude 
parameter AM (z) = M{z) - M{0) = a(l - a). This 
could perhaps arise from population drift in supernova 
environments or progenitor systems (without attempt- 
ing rigorous justification, we note that the offset should 
be bounded as the redshift gets large, especially as the 
cosmic time intervals grow shorter and the diversity of 
environments decreases). We find that the resulting pa- 
rameter biases can be written as 



Sp 
a{p) 



X{P) 



AM{z = 1.7) 
(102 '' 



(7) 



with X{n,y„wo,Wa,Wp) = -0.55, -0.14, -0.08, -0.50. So 
as before, Wp is substantially more biased in units of stan- 
dard deviation than wq- While Wa is very fairly esti- 
mated, now n,n is affected. Note, however, that at the 
level of AM — 0.02 between z — and 1.7 the cosmol- 
ogy fit is not strongly affected; e.g. the quadrature sum of 
dispersion and bias is increased by less than 14% relative 
to no magnitude evolution. 

If instead we treat possible evolution as an extra fit 
parameter a, this removes the bias, replacing it with 
an increased dispersion. With a gaussian prior of 0.04 
mag on AM{z = 1.7), the parameter estimation uncer- 
tainty on Wo increases by 4%, but on Wp increases by 
41%, relative to the no evolution case (the dispersion in 



Wa increases by 1% and in flm by 49%). Of course, ex- 
changing a systematic bias for a new fit parameter and 
increased dispersion only works if one knows the func- 
tional form of the systematic ~ that is the whole basis of 
"self-calibration" . 



D. Modified gravity 

The expansion history is specified by the equation of 
state ratio w{a), but the history of growth of structure in 
the universe depends on both the expansion history and 
the theory of gravity. If gravity is modified from general 
relativity, then the observables involving growth will be 
offset from the general relativity predictions. This in turn 
will cause a bias in cosmological parameters interpreted 
within the framework of Einstein gravity. 

Effects from modification of gravity can be quite com- 
plex, and there is no general treatment even in the lin- 
ear regime of structure formation. One approach is the 
growth index parametrization of i23l| ; this has been shown 
highly accurate in the linear growth factor for taking into 
account expansion history effects, and modified gravity 
in the DGP [2J| braneworld model. Another interesting 
approach, not yet fully developed, is phenomenological 
modification of the Poisson equation giving the source 
term of the growth equation; this will give a scale depen- 
dent growth factor 25]. 

In the growth index formalism, the linear growth factor 
of matter density perturbations g{a) — {Sp/p)/a is given 

by 
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FIG. 5: Modification of gravity, if interpreted in an Einstein 
gravity context, will bias tlie cosmological parameter estima- 
tion. Here we consider observational constraints from next 
generation linear growth factor measurements to 2% over 
z = — 2.8, plus supernova and CMB measurements; the 
modified gravity is parametrized through the growth index 7 
[23, with 7 — 0.55 in general relativity. The wo and Wa pa- 
rameters are reasonably robust, but the sweet spot, or pivot, 
value u)p (and to a less extent the matter density Q.m) can be 
appreciably biased. 



3(a) 



J^^da/a[n^(a)-<-l] 



(8) 



where 7 is the growth index. For a matter plus cosmo- 
logical constant universe, 7 = 0.55, and the formula is 
accurate to better than 0.05%. Modification of gravity 
will shift 7; for example the DGP growth factor is well 
fit (to 0.2%) by 7 = 0.68. 

To propagate the effects of modified gravity on growth 
through to cosmological parameter bias we offset 7 from 
the general relativity value. We then add future measure- 
ments giving the linear growth factor at 2; = 0, 0.4,. . . 2.8 
to 2% precision to the previously considered supernova 
and CMB distance observations. As shown in Fig. |S1 
again Wp is strongly biased, while wq is scarcely affected. 
Deviations in Wa are minor, and in ri,„ are appreciable 
but not severe for IA7I < 0.05. 



E. Density parametrization and crossover bias 

We have emphasized that parametrizations should be 
robust, i.e. unbiased. This means that they must be 
crafted specifically for the questions we want answered. 
If a parameter P is robust, i.e. its fit value equals the 
expectation value, then P^ or more generally some non- 
linear function f{P) is not unbiased. Thus if we want to 



learn about the dynamics w'-w of dark energy, we should 
parametrize the equation of state directly. 

Using other quantities such as dark energy density p 
or Hubble parameter H as a basis for parametrization is 
known to be improper and dangerous, when the aim is the 
dark energy equation of state. For example, [23 clearly 
demonstrated the instability and bias in w{a) from adopt- 
ing a functional form for p{z) or H{z), and |27l | showed 
that binned values p{zi) had similar pathology (although 
|27| pointed out that binned values in a or ln(l -I- z) are 
subject only to the usual, still worrying, numerical insta- 
bilities). 

Instabilities often lead to crossover behavior, where 
spurious evolution, e.g. from w<— ltow>— 1 occurs. 
|26 l| showed instances where this necessarily happened 
close to the minimum variance location - i.e. Wp « — 1 
was forced. Perhaps the earliest crossover models were 
given by ^S\ (the crossing of w = — 1 is now sometimes 
called the "phantom divide" 29]) and have some inter- 
esting properties relevant to parameter bias. When im- 
plemented by two scalar fields. 



w{z) = Wi 



5Hl 



5Ht 



6Hl 



W2 



SHI 



5H( 



SHl 



(9) 



where 6Hf is the contribution of component i to the Hub- 
ble expansion equation, the dependence of w{z) on the 
parameters Wi and Wj becomes nonhnear, and errors in 
their determination lead to the error in the reconstructed 
w{z) running away as In(l-l-z). This can even lead to false 
crossover behavior despite both fields having w > —1, 
say. Because observations tell us that the averaged value 
of w is not too different from -1, this means that any 
crossover must have happened at reasonably low redshift 
- i.e. the crossover redshift must be fairly close to the 
pivot redshift, forcing Wp ~ —1. 

(Note also that observational systematics as in ijlll CI 
can bias wq one way and Wa the other way, possibly caus- 
ing a crossover. A simple model where the local Hubble 
flow supernovae, measured with different instrumenta- 
tion than higher redshift supernovae, are offset in mag- 
nitude from the others can fulfill this condition. Hence, 
great care must taken with calibration, and a single ex- 
periment should cover as much of the full redshift range 
as possible.) 



IV. CONFIDENCE CONTOURS 

The considerations and calculations in this paper point 
out that the most precisely determined value oiw{z) - i.e. 
Wp - can also be the most sensitive to bias and misinter- 
pretation of the nature of the dark energy from improper 
parametrization or observational systematics. 

The presence of bias does not herald failure for under- 
standing dark energy but rather advocates for caution in 
interpretation and for complete description of the param- 
eter estimation. As shown, robust parametrization can 
obviate many of the problems, and, as in iJHI CI one can 
cure bias by judiciously chosen additional fit parameters. 

One should also distinguish between the absolute pa- 
rameter bias 5p and the fractional bias Sp/a{p); in many 
cases the fractional bias on Wp is larger than on wq be- 
cause Wp is more precisely determined. Still, if Wp is 
used to advertise precision, the fractional bias tells to 
what extent this is an accurate result. Statisticians often 
combine the precision, or dispersion ct(p), with the bias 
dp to form the "risk" on a parameter. 



r{p) = ^a^ip) + 6p^ = (t(p) (l + [6p/a{p)f 



,1/2 



(10) 



We see that the fractional bias then gives the increase 
from the statistical dispersion to the parameter risk. For 
many of the cases discussed in this paper, despite a higher 
fractional bias than wq, Wp still has a lower overall risk. 
Risk, however, is a matter of personal comfort not rig- 
orous mathematics, in cosmology as in the stock mar- 
ket^. Rather than having statistical precision and bias 



contribute equally, as in Eq. H10|l . we might be willing 
to pay a premium to have great confidence in our under- 
standing of fundamental physics, and weight robustness 
and low bias more strongly than mere statistical preci- 
sion. If we want to avoid false conclusions about, say, 
whether something other than the cosmological constant 
pervades our universe, we should seek experiments and 
parametrizations that stringently control bias. 

In any case, quoting a single parameter's statistical 
precision, bias, or risk withholds important information 
due to correlations between parameters. The likelihood 
surface for the set of parameters (usually shown as a 
two parameter confidence contour, marginalized or min- 
imized over the other parameters) retains and illustrates 
information on dispersion, bias, and degeneracies. 

Figure IHl illustrates the confidence contours for vari- 
ous fiducial models in the case of ijlll CI where an ob- 
servational offset in supernova magnitudes as a function 
of redshift biases the cosmological parameters. To show 
the bias clearly, we adopt AM{z = 1.7) such that Wp 
is biased by la in each case, and plot the la projected 
confidence contour (39% confidence level), so the biases 
can be read off directly from projection to the axes. We 
simultaneously show the WQ-Wa and Wp-Wa planes: the 
solid, black contours are for the wq cases, and the three 
legged symbol shows the best fit, while the dashed, red 
contours are for the Wp cases and the x shows the best 
fit. Each true cosmological model is indicated by the blue 
stars, one for wq, one for Wp. The measurement offset bi- 
ases the parameter estimation such that wq is much less 
biased in the fractional sense (and in this case in the ab- 
solute sense as well). However, the true model lies at an 
equal confidence level in either parametrization. 

In terms of the individual parameters, then, wq tends 
to be more robust than Wp for the fractional bias, and 
one should be wary of treating quotes of statistical pre- 
cision of Wp as robust. Better is to show the joint likeli- 
hood surface or confidence contour, which does provide 
an even handed assessment of bias. We saw in ijnl that 
the physical incisiveness of the contours depends on both 
the parametrization and location in phase space. The 
vertically oriented contours of Wp-Wa are optimal only in 
the "dead zone" between the physically motivated freez- 
ing and thawing behaviors (see |3,|j|)- Similarly, the area 
of the contour, equal in either plane [2] and conveniently 
written in the gaussian approximation as a{wp) x a[wa)^ 
is the optimal figure of merit only in the Snarkian"^ sense. 



rameter p, about a possibly biased mean, is 

((p-{p)f)>{i + a5v/dpf/F^^. 



(11) 



^ It is true that there are rigorous inequalities involving bias. The 
Rao-Cramer-Frechet bound 1301 states that the variance of a pa- 



This generalizes the usual Fisher result that the variance has a 
lower limit, ap > l/y/Fpp. 
^ In Lewis Carroll's Hunting of the Snark, in searching for the 
snark, whose nature was completely uncertain, the hunters were 
given a blank map. Could Carroll, a mathematician, have been 
commenting on likelihoods and optimal parametrization? 
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FIG. 6: Likelihood contours provide a fairer depiction of bias 
than one dimensional parameter uncertainties. Various fidu- 
cial models (with their wo and Wp values indicated simulta- 
neously by blue stars) are biased to new values of wq , Wp by 
differing amounts (respectively shown by black, three legs and 
red x's), but remain at the same confidence level. Contours 
in Wp-Wa space are always vertical, and their degeneracy axis 
intersects the degeneracy axis of the tilted Wo-Wa contours at 
Wa = (and the contour widths for Wa ~ are equal in either 
parametrization) . 



V. CONCLUSION 

Understanding the new physics lying behind the ac- 
celeration of the cosmic expansion requires precision in 
the measurements, accuracy in the measurements, and 
robustness in the interpretation of the data. We have 
tested the concept of the two parameter dark energy 
equation of state phase plane and demonstrated further 
that the standard WQ-Wa parametrization provides a ro- 
bust framework for interpreting dark energy, consider- 
ing systematic errors in the observations, more complex 



dark energy models, and gravity beyond general relativ- 
ity. The pivot, or decorrelation, value of the equation of 
state, Wp, is more subject to bias from such effects. 

Seeing the true nature of dark energy, not a subjec- 
tive, biased interpretation, is an exciting challenge. Ro- 
bust parametrization, yielding a fair, unbiased answer is 
one step, and points the way to another: complemen- 
tarity of probes plays a crucial role. We saw at the end 
of Wl Bl that a sufficiently rapid transition in the dark 
energy behavior could lead not only to a bias, but one 
that in a single parameter acts opposite to the direction 
of the transition, spoofing the nature of the dark energy. 
Combining more than one cosmological probe immunizes 
against this, by reducing the degeneracies that allow such 
an extreme distortion - as well as guarding against sys- 
tematic errors (or beyond Einstein gravity) that can also 
bias results. 

We found that one must be wary of uncertainties 
quoted on individual parameters, such as Wp that any- 
way lacks a standalone physical basis, varying based on 
the probe, survey, priors, and fiducial model. The like- 
lihood, or confidence contours in the equation of state 
plane, is a fairer depiction of the consistency of models 
with data. A single optimal figure of merit cannot be 
defined, however, for the dark energy phase space, but is 
informed by the physical structure of the dynamics, e.g. 
thawing and freezing regions. The use of the area of con- 
tour ellipses as proposed by the Dark Energy Task Force 
is ok, though limited, but one should not overinterpret 
the role of Wp for calculating the area as promoting Wp 
to a favored parameter, due to its fiaws. 

In fact, we seem led to either custom figures of merit 
following the physics in the robust WQ-Wa parametriza- 
tion or to taking another look at defining a series of 
benchmark models. Either way, the firm foundation of 
the dynamics w'-w and the standard parametrization 
provides realistic hope for learning the true nature of the 
cosmic acceleration. 
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